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DETAILED ACTION 

1 . The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

Response to Arguments 

2. Applicant's arguments filed on 9/1 1/2009 have been fully considered but they are 
not persuasive for the following reasons. 

3. The claims and only the claims form the metes and bounds of the invention. 
"Office personnel are to give claims their broadest reasonable interpretation in light of 
the supporting disclosure. In re Morris, 127 F.3d 1048, 1054-55, 44 USPQ2d 1023, 
1027-28 (Fed. Cir. 1997). Limitations appearing in the specification but not recited in 
the claim are not read into the claim. In re Prater, 415 F.2d 1393, 1404-05, 162 USPQ 
541 , 550-551 (CCPA 1 969)" (MPEP p 21 00-8, c 2, I 45-48; p 21 00-9, c 1 , I 1 -4). The 
Examiner has full latitude to interpret each claim in the broadest reasonable sense. The 
Examiner will reference prior art using terminology familiar to one of ordinary skill in the 
art. Such an approach is broad in concept and can be either explicit or implicit in 
meaning. 

Regarding rejection to claims 10-18 under 35 USC 112, first paragraph for the 
newly added limitation " prior to any subsequent user input ". The applicant argues 
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(Remarks, page 4) that specification ([0028]) states steps 6-8 can be omitted. 
Moreover, the specification states that the assignment of a new command to the 
unrecognized voice pattern or utterance takes place in a fifth step 5 of the method. This 
step follows immediately if a voice pattern is not recognized as claimed in independent 
claim 1. Paragraph [0021] of the present specification discloses furthermore as another 
alternative the option to return to step 1 . Hence, Applicant believes that the previous 
amendment is fully supported by the specification. 

In response, the Examiner notes even though specification [0028] states steps 6- 
8 can be omitted, omitting some steps does not support the limitation "prior to any 
subsequent user input". The applicant asserts paragraph [0021] supports the limitation. 
However, it is evidenced in [0021] that the user assigns a new command to the 
unrecognized voice pattern via the user interface of the computer system (must 
have some user inputs) and the speech recognition system is switched into a training 
mode, to repeat the voice utterance (have some user inputs for training). It is clear 
specification ([0021] and [0028]) does not support the limitation "prior to any subsequent 
user input". The rejection under 35 USC 112 1 st paragraph is maintained. 

Regarding claim 10, the applicant argues (Remarks, page 5) nowhere in 
Everhardt can anything be found about assigning a so far unknown utterance to a new 
command. Hence, a combination of Everhardt with any of the other cited references will 
clearly not lead to the claimed subject matter. 
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In response to applicant's arguments against the references individually, one 
cannot show nonobviousness by attacking references individually where the rejections 
are based on combinations of references. See In re Keller, 642 F.2d 413, 208 USPQ 
871 (CCPA 1981); In re Merck & Co., 800 F.2d 1091, 231 USPQ 375 (Fed. Cir. 1986). 

Gammel and Hon teach providing an opportunity to assign non-recognized 
utterance to a new command. Everhardt is cited to teach the newly added limitation 
"prior to any subsequent user input". Everhardt discloses a speaker dependent in-car 
speech recognition system. When user speakers a voice command, the system 
presents a N-best matches to the user. The system adapted the speech recognition 
system to recognized a non-top candidate from the N-best list without asking user to 
train the system ("prior to any subsequent user input"). 

Drawings 

4. The drawings are objected to under 37 CFR 1 .83(a). The drawings must show 
every feature of the invention specified in the claims. 

The applicant argues (Remarks, page 4) that steps 6-8 can be omitted to support 
the newly added limitation "prior to any subsequent user input" in claims 10 and 16. 
However, the Examiner notes that there is no path in the drawing that can go from step 
5 directly to step 9. 
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Corrected drawing sheets in compliance with 37 CFR 1.121(d) are required in 
reply to the Office action to avoid abandonment of the application. Any amended 
replacement drawing sheet should include all of the figures appearing on the immediate 
prior version of the sheet, even if only one figure is being amended. The figure or figure 
number of an amended drawing should not be labeled as "amended." If a drawing figure 
is to be canceled, the appropriate figure must be removed from the replacement sheet, 
and where necessary, the remaining figures must be renumbered and appropriate 
changes made to the brief description of the several views of the drawings for 
consistency. Additional replacement sheets may be necessary to show the renumbering 
of the remaining figures. Each drawing sheet submitted after the filing date of an 
application must be labeled in the top margin as either "Replacement Sheet" or "New 
Sheet" pursuant to 37 CFR 1.121(d). If the changes are not accepted by the examiner, 
the applicant will be notified and informed of any required corrective action in the next 
Office action. The objection to the drawings will not be held in abeyance. 

Claim Rejections - 35 USC §112 

5. Claim 10-18 are rejected under 35 U.S.C. 1 12, first paragraph, as failing to 
comply with the written description requirement. The claim(s) contains subject matter 
which was not described in the specification in such a way as to reasonably convey to 
one skilled in the relevant art that the inventor(s), at the time the application was filed, 
had possession of the claimed invention. 
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The applicant amended independent claims 10 and 16 by adding a new limitation 
" prior to any subsequent user input " . 

This limitation is not support in the original disclosure. Specification paragraph 
[0024-0027] and step 6-9 in figure show that in order to assign an non-recognized 
utterance to a command, the system requests the user to speaker the utterance again 
(step 6, new recording) and select an action with the aid of the user interface (step 9, 
command assignment). Specification ([0021]) also shows that a user assigns a new 
command via the user interface of the computer system and the speech recognition 
system is switched into a training mode (must have user input before assigning non- 
recognition to a new command). 

Claim Rejections - 35 USC § 103 

6. Claims 1 0-1 8 are rejected under 35 U.S.C. 1 03(a) as being unpatentable over 
Gammel et al. (US Pat. 5,832,429, hereinafter referred to as Gammel) in view of Hon et 
al. (US Pat. 5,852,801 , hereinafter referred to as Hon) and further in view of Everhart et 
al. (US Pat. 6,587,824, hereinafter referred to as Everhart). 

With respect to independent claim 10, Gammel teaches a speaker -dependent 
speech recognition method recognizing speech with a speech 
recognition system (Fig. 1; col. 1, lines 6-8; col. 2, lines 1-20, the invention relates to 
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speech recognition and a speech recognition database in a system, comprising speaker dependent 
templates for recognition) , the method comprising: 

• providing that voice utterances of a user are trained and 
commands are assigned to the trained voice utterances (col. 2, 
lines 12-20, telephone system contains speaker dependent templates for entry 
names and corresponding phone numbers for speed dial) ; 
but although Gammel teaches a method to assign the voice utterance to a new 
command (Figs. 4, 5, 7-9; col. 3, lines 33-45; col. 5, lines 12-23, new speed dial names are 
enrolled in a speed dial list), Gammel does not teach that it is done upon non- 
recognition of a voice utterance and via the speech recognition 
system . However, the examiner contends that this concept was well known in the art, as 
taught by Hon. 

In the same field of endeavor of speech recognition, Hon teaches a method for speech 
recognition in which if a word is not recognized (Fig. 2, element 115; col. 7, 28-35; col. 8, lines 
28-29), the user is prompted to invoke a new word acquisition method (Fig. 2, element 100, Fig. 
3, element 169; col. 7, lines 36-48; col. 8, lines 50-60), and the unrecognized word may be added 
to the lexicon (Fig. 2, element 117, Fig. 4, element 187; col. 7, lines 49-51; col. 9, lines 36-38), 
along with other user-provided attributes (col. 9, lines 36-38). It is noted that a command is also 
a word with associated attributes, and that the recognized word may be a command (col. 6, lines 
33-36). 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to modify the speech recognition method of Gammel with the automatically 
invoked step of adding a new voice utterance, as taught by Hon, in order to increase ease of use 
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for users by not requiring prior knowledge of words not in the lexicon and providing a user 
interface for entering a word into the lexicon (Hon, col. 1, line 57-col. 2, line 15). 

The combined teaching of Gammel and Hon disclose assigning a non- 
recognized voice utterance to a new command but does not explicitly disclose providing 
an opportunity to add the new command prior to any subsequent user input. 

Everhart discloses a method of improving speech recognition performance by 
adapting a speech recognition engine for a particular command (add new command) 
from a N-best matches for a particular speaker prior to any subsequent user input (col. 
2, lines 27-55, fig. 6, a particular command is adapted (added) to the system from 
previous command using N-best matches without requesting a user to repeat the 
voice command again (prior to any subsequent user input)). 

Gammel, Hon and Everhart are analogous art and from a similar field of 
applicant's endeavor in speech recognition. Therefore, it would have been obvious to a 
person having ordinary skill in the art at the time the invention was made to modify 
Gammel in view of Hon's teaching with Everhart's teaching to adapt (add) command 
without requesting user to repeat the command to train the system. One having ordinary 
skill in the art would have been motivated to make such a modification because the 
system is simple to use (Everhart, col. 2, lines 23-25). 
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With respect to claim 11, Gammel, Hon and Everhart teach everything claimed, as 
applied above (see claim 10); in addition, Gammel does not but Hon teaches a speaker- 
dependent speech recognition method as claimed in claim 10, 
wherein, upon the non- recognition of the voice utterance by the 
speech recognition system (Fig. 3, col. 8, lines 28-29, the word cannot be 
determined), the user may one of repeat the voice utterance and 
assign a new command to the voice utterance (Fig. 3, col. 8, lines 31-32, the 
user repeats the word or phrase (157)) . 

It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to modify the speech recognition method of Gammel with the step of allowing the user 
to repeat an unrecognized utterance, as taught by Hon, in order to increase the probability of 
correct recognition in the event that the user misspeaks or is otherwise inconsistent in speaking. 

With respect to claim 12, Gammel, Hon and Everhart teach everything claimed, as 
applied above (see claim 10); but Gammel, Hon Everhart do not explicitly teach a speaker- 
dependent speech recognition method as claimed in claim 10, 
wherein if no command has yet been assigned to a voice utterance, 
the speech recognition system, after having been activated, 
offers the training of a new command . However, Gammel does teach that the 
telephone system stores speaker dependent templates, which are used for recognition for 
commands (col. 1, lines 38-39; col. 2, lines 16-18 and 31-33), as well as a method for adding 
templates to the database (Figs. 4, 5, 7-9; col. 3, lines 33-45; col. 5, lines 12-23). Since the 
method of Gammel cannot be implemented without enrolled voice commands, the templates 
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must have been created prior to using the method. Therefore, it would have been obvious to one 
of ordinary skill in the art at the time the invention to modify the method of Gammel to allow the 
user to create the templates if they have not already been created, because this enables the speech 
recognizer to be more useful to the user. 

With respect to claim 13, Gammel, Hon and Everhart teach everything claimed, as 
applied above (see claim 10); in addition, Hon further teaches a speaker-dependent 
speech recognition method as claimed in claim 10, wherein upon 
the non-recognition of a voice utterance (Fig. 3, col. 8, lines 12-18, the 
desired word is not the most likely recognized word) for a command already trained 
by the speech recognition system (Fig. 3, col. 8, lines 20-28, the desired word 
may be found on an N-best list of alternatives; Fig. 4, lines 15-19, the unrecognized word may 
already be in the lexicon) , the user may select the command and assign 
the voice utterance to the selected command (Fig. 3, col. 8, lines 20-28, the 
unrecognized word is selected from the N-best list; Fig. 4, col. 9, lines 15-27, the speech model is 
modified to increase the probability of recognition in the future) . 

It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to modify the speech recognition method of Gammel with the step of allowing the user 
to correct an unrecognized utterance, as taught by Hon, in order to increase the future accuracy 
of the system by modifying it to a particular speaker's utterances (Hon, col. 9, lines 15-27). 



With respect to claim 14, Gammel, Hon and Everhart teach everything claimed, as 
applied above (see claim 10); in addition, Hon does teach a speaker -dependent speech 
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recognition method as claimed in claim 10, wherein for 
recognition of a voice utterance, a voice pattern is generated 
which is assigned to the voice utterance (col. 5, lines 46-65, utterance is 
divided and converted into observed vectors to represent the utterance data) . 

It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to modify the method of Gammel with the vector creation step of Hon, because it 
would improve accuracy by fine-tuning the recognizer to a particular user's speech. 

With respect to claim 15, Gammel, Hon and Everhart teach everything claimed, as 
applied above (see claim 10); in addition, Gammel further teaches a speaker -dependent 
speech recognition method as claimed in claim 10, wherein before 
a command is assigned to a voice utterance, a check is carried 
out to determine whether the voice utterance is similar to 
previously stored voice utterances (Fig. 5, col. 6, lines 38-49, a check is made 
to determine if the word is already on the list or close to a word that is on the list) . 

With respect to independent claim 16, Gammel teaches a speech recognition 
system for a speaker-dependent recognition of voice (Fig. 1 ; col. 1 , 
lines 6-8; col. 2, lines 1-20, the invention relates to a speech recognition database in a system 
comprising speaker dependent templates for recognition) , comprising : 

• a voice recording device for recording a voice utterance of 
a user of the speech recognition system (Fig. 1, col. 2, lines 6-8, 
system comprises a recognition and record circuit (14)) ; 
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• a search engine for accessing a database which contains an 
assignment between voice utterances and commands in order to 
find a command assigned to the voice utterance (Fig. 1, col. 2, 
lines 29-33; col. 2, lines 12-20, processor (12) with comparator and memory (1 5) 
compares user's utterance to speaker dependent templates for entry names and 
corresponding phone numbers for speed dial) ; and 

• a conversion device for converting the command found due to 
the voice utterance (col. 2, lines 48-55, telephone system recognizes 
command phrases and proceeds according to the requested command, for 
example automatically dialing numbers) 

but although Gammel teaches assign [ing] the voice utterance to a new 
command (Figs. 4, 5, 7-9; col. 3, lines 33-45; col. 5, lines 12-23, new speed dial names 
are enrolled in a speed dial list), Gammel does not teach that it is done upon non- 
recognition of the voice utterance. 

However, the examiner contends that this concept was well known in the art, as taught by Hon. 

In the same field of endeavor of speech recognition, Hon teaches a system for speech 
recognition in which if a word is not recognized (Fig. 2, element 115; col. 7, 28-35; col. 8, lines 
28-29), the user is prompted to invoke a new word acquisition method (Fig. 2, element 100, Fig. 
3, element 169; col. 7, lines 36-48; col. 8, lines 50-60), and the unrecognized word may be added 
to the lexicon (Fig. 2, element 117, Fig. 4, element 187; col. 7, lines 49-51; col. 9, lines 36-38), 
along with other user-provided attributes (col. 9, lines 36-38). It is noted that a command is also 
a word with associated attributes, and that the recognized word may be a command (col. 6, lines 
33-36). 
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Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to modify the speech recognition system of Gammel with the automatically 
invoked step of adding a new voice utterance, as taught by Hon, in order to increase ease of use 
for users by not requiring prior knowledge of words not in the lexicon and providing a user 
interface for entering a word into the lexicon (Hon, col. 1, line 57 -col. 2, line 15). 

The combined teaching of Gammel and Hon disclose assigning a non- 
recognized voice utterance to a new command but does not explicitly disclose providing 
an opportunity to add the new command prior to any subsequent user input. 

Everhart discloses a method of improving speech recognition performance by 
adapting a speech recognition engine for a particular command (add new command) 
from a N-best matches for a particular speaker prior to any subsequent user input (col. 
2, lines 27-55, fig. 6, a particular command is adapted (added) to the system from 
previous command using N-best matches without requesting a user to repeat the 
voice command again (prior to any subsequent user input)). 

Gammel, Hon and Everhart are analogous art and from a similar field of 
applicant's endeavor in speech recognition. Therefore, it would have been obvious to a 
person having ordinary skill in the art at the time the invention was made to modify 
Gammel in view of Hon's teaching with Everhart's teaching to adapt (add) command 
without requesting user to repeat the command to train the system. One having ordinary 
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skill in the art would have been motivated to make such a modification because the 
system is simple to use (Everhart, col. 2, lines 23-25). 

With respect to claim 17, Gammel, Hon and Everhart teach everything claimed, as 
applied above (see claim 16); in addition, Gammel further teaches a speech recognition 
system as claimed in claim 16, wherein the voice recording device 
(Fig. 1, col. 2, lines 6-8, system comprises a recognition and record circuit (14)) is 
connected to a memory in which the voice utterance is temporarily 
stored (Fig. 1, col. 2, lines 29-33; col. 2, lines 12-20, processor (12) with comparator and 
memory (15)) and which is connected to the database for reading the 
voice utterance into the database (Fig. 1, col. 2, lines 29-33, encoded templates 
are in the memory (15)) . 

With respect to claim 18, Gammel, Hon and Everhart teach everything claimed, as 
applied above (see claim 16); in addition, Gammel does not but Hon does teach a speech 
recognition system as claimed in claim 16, further comprising a 
feature extraction device for generating a voice pattern from the 
voice utterance (Fig. 1A, 1C, & 2; col. 5, lines 46-65, signal processor (111) divides the 
digitized utterance into frames and creates a vector for each slice of the vector) , the 
feature extraction device being arranged between the voice 
recording device and the memory (Fig. 1 A, sound sampling device (1 1), memory 
(3), and digital signal processor (6) are all connected via a bus (1)) , with the voice 
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pattern replacing the voice utterance {col. 5, lines 46-65; col. 6, lines 7-18; 
vectors represent and summarize the utterance, and are used in the comparison) . 

It would have been obvious to one of ordinary skill in the art at the time the invention 
was made to modify the system of Gammel with the vector creation step of Hon, because it 
would improve accuracy by fine-tuning the recognizer to a particular user's speech. 

Conclusion 

7. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1 .136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 

8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to JIALONG HE whose telephone number is (571)270- 
5359. The examiner can normally be reached on Monday-Thursday, 7:00 - 4:30, Alt 
Friday, EST. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Richemond Dorvil can be reached on (571) 272-7602. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/JH/ 

/Richemond Dorvil/ 

Supervisory Patent Examiner, Art Unit 2626 



